why men start to care when you stop